On a Gel'fand-Yaglom-Peres theorem for f-divergences
نویسنده
چکیده
Abstract. It is shown that the f -divergence between two probability measures P and R equals the supremum of the same f -divergence computed over all finite measurable partitions of the original space, thus generalizing results previously proved by Gel’fand and Yaglom and by Peres for the Information Divergence and more recently by Dukkipati, Bhatnagar and Murty for the Tsallis’ and Rényi’s divergences.
منابع مشابه
Gel ' fand n - Widths and the Method of Least Squares
Consider the problem of estimating a function f known to lie in a convex, compact subset F of L2[0, 1], when one observes data on f containing white Gaussian noise. We establish an upper bound on the integrated mean-squared error of least-squares estimates which uses the asymptotic properties of the Gel'fand n-widths of F. The bound shows that if the Gel'fand n-widths tend to zero at a faster r...
متن کاملf -DIVERGENCES - REPRESENTATION THEOREM AND METRIZABILITY
In this talk we are first going to state the so-called ’Representation Theorem’ which provides the representation of general f -divergences in terms of the class of elementary divergences. Then we consider the risk set of a (simple versus simple) testing problem and its characterization by the above mentioned class. These ingredients enable us to prove a sharpening of the ’Range of Values Theor...
متن کاملCSISZÁR’S f -DIVERGENCES - BASIC PROPERTIES
In this talk basic general properties of f -divergences, including their axiomatic, and some important classes of f -divergences are presented. Without essential loss of insight we restrict ourselves to discrete probability distributions and note that the extension to the general case relies strongly on the Lebesgue-Radon-Nikodym Theorem.
متن کاملNew Rates for Exponential Approximation and the Theorems of Rényi and Yaglom
We introduce two abstract theorems that reduce a variety of complex exponential distributional approximation problems to the construction of couplings. These are applied to obtain rates of convergence with respect to the Wasserstein and Kolmogorov metrics for the theorem of Rényi on random sums and generalizations of it, hitting times for Markov chains, and to obtain a new rate for the classica...
متن کاملInvestigation to Reliability of Optical Communication Links using Auto-Track Subsystems in Presence of Different Beam Divergences
In this paper, we investigate the effects of auto-tracking subsystem together with different beam divergences on SNR, BER and stability of FSO communication links. For this purpose we compute the values of power, SNR and BER on receiver, based on analytic formula of Gaussian beam on receiver plane. In this computation the atmospheric effects including absorption, scattering and turbulence are c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/0911.1934 شماره
صفحات -
تاریخ انتشار 2009